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Abstract. The performance of codes defined from graphs depends on the 
expansion property of the underlying graph in a crucial way. Graph products, 
such as the zig-zag product 1131 and replacement product provide new infinite 
families of constant degree expander graphs. The paper investigates the use 
of zig-zag and replacement product graphs for the construction of codes on 
graphs 16j. A modification of the zig-zag product is also introduced, which 
can operate on two unbalanced biregular bipartite graphs. 

1. Introduction 

Expander graphs are of fundamental interest in mathematics and engineering 
and have several applications in computer science, complexity theory, designing 
communication networks, and coding theory [51 [Tl \T7\. In a remarkable paper 13j 
Reingold, Vadhan, and Wigderson introduced an iterative construction which leads 
to infinite families of constant degree expander graphs. The iterative construction 
is based on the zig-zag graph product introduced by the authors in the same paper. 
The zig-zag product of two regular graphs is a new graph whose degree is equal 
to the square of the degree of the second graph and whose expansion property 
depends on the expansion properties of the two component graphs. In particular, 
if both component graphs are good expanders, then their zig-zag product is a good 
expander as well. Similar things can be said about the replacement product. 

Since the work of Sipser and Spielman jl5| it has been well known that the 
performance of codes defined on graphs depends on the expansion property of the 
underlying graph in a crucial way. Several authors have provided constructions of 
codes from graphs whose underlying graphs are good expanders. In general, a graph 
that is a good expander is particularly suited for the message-passing decoder that is 
used to decode low density parity check (LDPC) codes, in that it allows for messages 
to be dispersed to all nodes in the graph as quickly as possible. Furthermore, 
graphs with good expansion yield LDPC codes with good minimum distance and 
pseudocodeword weights [11 [6l [7l [HI [15] . 
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Probably the most prominent example of expander graphs are the class of Ra- 
manujan graphs which are characterized by the property that the second eigenvalue 
of the adjacency matrix is minimal inside the class of /c-regular graphs on n ver- 
tices. This family of 'maximal expander graphs' was independently constructed by 
Lubotzky, Phillips and Sarnak [10] and by Margulis [TT] . The description of these 
graphs and their analysis rely on deep results from mathematics using tools from 
graph theory, number theory, and representation theory of groups |9] . Codes from 
Ramanujan graphs were constructed and studied by several authors [71 [HI fT5] . 

Ramanujan graphs have the drawback that they exist only for a limited set of 
parameters. In contrast, the zig-zag product and the replacement product can be 
performed on a large variety of component graphs. The iterative construction also 
has a lot of engineering appeal as it allows one to construct larger graphs from 
smaller graphs as one desires. This was the starting point of our research reported 

In this paper we examine the expansion properties of the zig-zag product and 
the replacement product in relation to the design of LDPC codes. We also in- 
troduce variants of the zig-zag scheme that allow for the component graphs to be 
unbalanced bipartite graphs. In our code construction, the vertices of the product 
graph are interpreted as sub-code constraints of a suitable linear block code and the 
edges are interpreted as the code bits of the LDPC code, as originally suggested by 
Tanner in 16]. Codes obtained in this way will be referred to as generalized LDPC 
(GLDPC) codes. By choosing component graphs with relatively small degree, we 
obtain product graphs that are relatively sparse. Examples of each product and 
resulting LDPC codes are given to illustrate the results of this paper. Some of 
the examples use Cayley graphs as components, and the resulting product graph 
is also a Cayley graph with the underlying group being the semi-direct product of 
the component groups, and the new generating set being a function of the gener- 
ating sets of the components [2]. Simulation results reveal that LDPC codes based 
on zig-zag and replacement product graphs perform comparably to, if not better 
than, random LDPC codes of comparable block lengths and rate. The vertices of 
the product graph must be fortified with strong (i.e., good minimum distance) sub- 
code constraints, in order to achieve good performance with message-passing (or, 
iterative) decoding. 

The paper is organized as follows. Section [2] discusses preliminaries on the formal 
definition of expansion for a d-regular graph and the best one can achieve in terms 
of expansion. Furthermore, expansion for a general graph is discussed. Section [3] 
describes the original zig-zag product and replacement product. A first result on 
the girth and diameter of the replacement product is derived. 

Section [4] contains a new zig-zag product construction of unbalanced bipartite 
graphs. The main result is Theorem [1] which essentially states that the constructed 
bipartite graph is a good expander graph if the two component graphs are good 
expanders. 

Section [5] is concerned with applications to coding theory. The section contains 
several code constructions using the original and the unbalanced bipartite zig-zag 
products and the replacement product. Simulation results of the LDPC codes con- 
structed in Section \E\ are presented in Section [SI Section [7| introduces a new itera- 
tive construction for an unbalanced bipartite zig-zag product and the replacement 
product to generate families of expanders with constant degree. For completion, the 
iterative construction for the original zig-zag product from [13j is also described. 
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The expansion for the iterative famihes are also discussed. Section [8] summarizes 
the results and concludes the paper. 

2. Preliminaries 

In this section, we review the basic graph theory notions used in this paper. 

Let G = {V, E) be a graph with vertex set V and edge set E. The number of 
edges involved in a path or cycle in G is called the length of the path or cycle. The 
girth of G is the length of the shortest cycle in G. lix,y €V are two vertices in G, 
then the distance from x to y \s defined to be the length of the shortest path from 
X to y. If no such path exists from x to y, then we say the distance from a; to y is 
infinity. The diameter of G is the maximum distance among all pairs of vertices of 
G. 

Intuitively, a graph has good expansion if any small enough set of vertices in 
the graph has a large enough set of vertices connected to it. It is now almost 
common knowledge that for a graph to be a good expander |15J , the second largest 
eigenvalue of the adjacency matrix A must be as small as possible compared to 
the largest eigenvalue [17]. For a d-regular graph G, the index (or, the largest 
eigenvalue) of the adjacency matrix A is d. Hence, by normalizing the entries of 
A by the factor d, the normalized matrix A = has the largest eigenvalue equal 
to 1. 

Definition 1. Let G be a d-regular graph on N vertices. Denote by A(G) the 
second largest eigenvalue of the normalized adjacency matrix A representing G. G 
is said to be a {N, d, X)-graph if A = A(G). 

In this paper, we will follow the definition provided in [31 [T^] for a graph to be 
an expander. 

Definition 2. A sequence of graphs is said to be an expander family if for every 
(connected) graph G in the family, the second largest eigenvalue A(G) is bounded 
below some constant k < 1. In other words, there is an e > such that for every 
graph G in the family, A(G) < 1 — e. A graph belonging to an expander family is 
called an expander graph. 

Alon and Boppana have shown that for a d-regular graph G, as the number 
of vertices n in G tends to infinity, A(G) > [T]. For d-regular (connected) 

graphs, the best possible expansion based on the eigenvalue bound is achieved by 
Ramanujan graphs that have A(G) < '^^'^^^ [TO] , Hence, Ramanujan graphs are 
optimal in terms of the eigenvalue gap 1 — A(G). 

The definition of expansion to d-regular graphs can be similarly extended to 
(c, (i)-regular bipartite graphs as defined below and also to general irregular graphs. 

Definition 3. A graph G — {X, Y; E) is (c, d)-regular bipartite if the set of vertices 
in G can be partitioned into two disjoint sets X and Y such that all vertices in X 
(called left vertices) have degree c and all vertices in Y (called right vertices) have 
degree d and each edge e G i? of G is incident with one vertex in X and one vertex 
in Y , i.e., e = {x, y),x G X,y ^ Y. 
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Definition 4. A (c, (i)-regular bipartite graph G on N left vertices and M right 
vertices is said to be a (N, M, c, d, X)-graph if the second largest eigenvalue of the 
normalized adjacency matrix A representing G is A. 

The largest eigenvalue of a (c, d)-regular graph is Vcd- Once again, normalizing 
the adjacency matrix of a (c, (i)-regular bipartite graph by its largest eigenvalue Vcd, 
we have that the (connected) graph is a good expander if second largest eigenvalue of 
its normalized adjacency matrix is bounded away from 1 and is as small as possible. 

To normalize the entries of an irregular graph G defined by the adjacency matrix 
A = {ttij), we scale each {i^jY^ entry in A by where ri and Cj are the i*^ 

row weight and j*^ column weight, respectively, in A. It is easy to show that the 
resulting normalized adjacency matrix has its largest eigenvalue equal to one. The 
definition of an expander for an irregular graph G can be defined analogously. 

3. Graph Products 

In designing codes over graphs, graphs with good expansion, relatively small 
degree, small diameter, and large girth are desired. Product graphs give a nice 
avenue for code construction, in that taking the product of small graphs suitable 
for coding can yield larger graphs (and therefore, codes) that preserve these desired 
properties. Standard graph products, however, such as the Cartesian product, 
tensor product, lexicographic product, and strong product, all yield graphs with 
large degrees. Although sparsity is not as essential for generalized LDPC codes, 
large degrees significantly increase the complexity of the decoder. 

In this section we describe the zig-zag product of [SI US] , introduce a variation 
of the zig-zag product that holds for bi-regular (unbalanced) bipartite graphs, and 
review the replacement product. In each case, the expansion of the product graph 
with respect to the expansion of the component graphs is examined. When the 
graph is regular-bipartite, this bi-regular product yields the product in [51 [13]. In 
addition to preserving expansion, these products are notable in that the resulting 
product graphs have degrees dependent on only one of the component graphs, and 
therefore can be chosen to yield graphs suitable for coding. 

3.1. Zig-zag product. Let Gi be a (A^i, di, A(^))-graph and let G2 be a (1^1,^2, 
^(2))_gj-aph. Randomly number the edges around each vertex of Gi by {1, . . . , c?i}, 
and each vertex of G2 by {1, ... , dij.Then the zig-zag product G = Gi@G2 of Gi 
and G2, as introduced in [51 [T3], is a (iVi ■ di,d\, A)-graph defined as follow^: 

• vertices of G are represented as ordered pairs [v, k), where w g {1,2,..., A'^i} 
and k S {1,2,..., di}. That is, every vertex in Gi is replaced by a cloud of 
vertices of G2. 

• edges of G are formed by making two steps on the small graph and one step 
on the big graph as follows: 

— a step "zig" on the small graph G2 is made from vertex {v, k) to ver- 
tex {v,k[i]), where k[i] denotes the i*'* neighbor of k in G2, for i £ 

{l,2,...,d2}. 



^ This is actually the second presentation of the zig-zag product given in 1131 : the original 
description required £ = k[i] in step 2 of the product, i.e. each endpoint of a,n edge had to have 
the same label. 
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— a deterministic step on the large graph Gi is made from vertex {v,k[i]) 
to vertex where v[k[i]] is the k[iY'^ neighbor of v in Gi and 
correspondingly, v is the £*'^ neighbor of v[k[i]] in Gi. 

— a final step "zo^" on the small graph G2 is made from vertex (i;[A;[7;]], ^) 
to vertex where £[j] is the j"' neighbor of £ in G2, for j G 

{l,2,...,d2}. 

Therefore, there is an edge between vertices {v,k) and ^[j]) for i,j € 

{l,...,d2}. 




Figure 1 . Zig-Zag product of two graphs. 



Example 1. Consider the zig-zag product graph G = Gi@G2 depicted in Figure 
1. The edge from (1,3) ("cloud ai, vertex 3") to (5,2) ("cloud 05, vertex 2") is 
obtained by the following 3 steps: 

(1,3)-. (1,4)^ (5,3)^ (5,2) 

The first step from 3 to 4 in cloud ai takes (1, 3) to (1, 4). The second step from ai 
to as in Gi takes (1, 4) to (5, 3), since as is the 4th neighbor of ai and ai is the 3rd 
neighbor of as in the labeling around the vertices of Gi. The final step in cloud as 
takes (5,3) to (5,2). Similarly, vertex (1,3) also connects to (5, 4), (3, 4), and (3,6) 
by these steps: 

(1,3)^(1,4)^(5,3)^(5,4) 
(1,3)^(1,2)^(3,5)^(3,4) 
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(1,3)^(1,2)^(3,5)^(3,6), 
so the degree of vertex (1, 3) is 2^ = 4 as expected. 

It is shown in [13] that the zig-zag product graph G = Gi(z)G2 is a {Ni-di, A)- 
graph with A < A^^^ + A^^) + [A(2)]2, and further, that A < 1 if A^^) < 1 and A'^) < 1. 
Therefore, the degree of the zig-zag product graph depends only on the smaUer 
component graph whereas the expansion property depends on the expansion of 
both the component graphs, i.e., it is a good expander if the two component graphs 
are good expanders. 

Lemma 1. Let Gi and G2 have girth gi and g2, respectively. Then the zig-zag 
product graph G ~ Gi(z)G2 has girth g — 4. 

Proof. We show that any pair of vertices at distance two in G2 are involved in a 
4-cycle in G. Consider two vertices (ui, ki) and {vi, ^2) in the same cloud of G that 
lie at distance two apart in G2. Let (vi^k^) be their common neighbor. In step 1 
of the zig-zag product, an edge will start from (vi, ki) and (wi, ^2) to {vi, k^). Note 
that the deterministic step will then continue the edge from (vi^k^) to a specified 
vertex {v,k) in another cloud. Therefore, with step 3, the actual edges in G will 
go from (z;i,A;i) to the neighbors of {v,k), and from (wi,/c2) to the neighbors of 
(5, k). Therefore, [vi, ki) and (wi, k2) are involved in a 4-cycle provided {v, k) does 
not have degree 1. Since it is assumed G2 is a connected graph with more than 2 
vertices, there is a pair of vertices such that the resulting (w, fc) has degree > 1 in 
G2. □ 

We now consider the case when the two component graphs are Cayley graphs [2] . 
Suppose Gi — G{Ga, So) is the Cayley graph formed from the group Ga with Sa 
as its generating set. This means that Gi has the elements of Ga as vertices and 
there is an edge from the vertex representing g € Ga to the vertex representing 
h G Ga li for some s € Sa, g * s = h, where '*' denotes the group operation. If the 
generating set Sa is symmetric, i.e., if a g S'a implies G Sa, then the Cayley 
graph is undirected. 

Let the two components of our (zig-zag product) graph be Cayley graphs of the 
type Gi = G{Ga, Sa) and G2 = C{Gb, Sb) and further, let us assume that there is 
a well-defined group action by the group Gf, on the elements of the group Ga- For 
g G Ga and h £ Gb, let g'^ denote the action of h on g. Then the product graph 
is again a Cayley graph. More specifically, if Gi = C[Ga,Sa) and G2 = G{Gb, Sb), 
and if Sa is the orbit of k elements oi, 02, . . . , afc € Ga under the action of Gf,, then 
the generating set S for the Cayley (zig-zag product) graph is 

S = {(1g„, /3)(a., 1gJ(1g„, /3')l /3, /?' G 5^, z e 1, . . . , k}. 

The group having as elements the ordered pairs {{g,h)\g e Ga,h e Gb}, and 
group operation defined by 

{g',h'){g,h)^{g'g'^'-\h'h) 

is called the semi-direct product of Ga and Gb, and is denoted by Ga x Gb- It is 
easily verified that when k — 1, the Cayley graph G{Ga x Gb,S) is the zig-zag 
product originally defined in [13;. The degree of this Cayley graph is at most fcjS'bp 
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if we disallow multiple edges between vertices. When the group sizes Ga and Gb 
are large and the k distinct elements ai, 02, . . . , g Ga are chosen randomly, then 
the degree of the product graph is almost always fcjS'bp. 

3.2. Replacement product. Let Gi be a (iVi, di, A^^^)-graph and let G2 be a 
(di, c?2, A'^')-graph. Randomly number the edges around each vertex of Gi by 
{l,...,c?i}, and each vertex of G2 by Then the replacement prod- 

uct G = Gi@G2 of Gi and G2 has vertex set and edge set defined as follows: the 
vertices of G are represented as ordered two tuples {v,k), for v e {l,2,...,A'^i} 
and fee {1,2,..., di}. There is an edge between {v, k) and (w, t) if there is an edge 
between k and £ in G2; there is also an edge between (w, k) and {w, £) if the fc*'* edge 
incident on vertex v in Gi is connected to vertex w and this edge is the edge in- 
cident on w in Gi. Note that the degree of the replacement product graph depends 
only on the degree of the smaller component graph G2. The replacement product 
graph G = Gi@G2 is a (A^i • di, da + 1, A)-graph with A < {p+ (1 -p)/(A(i) , A^^) ))i/3 
iorp = dl/{d2 + If, where /(A(i',A(2)) = A^^) + A'^) + [A(2)]2 ^13^ Theorem 6.4]. 




Figure 2. Replacement product of two graphs. 



Example 2. Consider the replacement product graph G = Gi@G2 shown in Figure 
3. The vertex (1,6) ("cloud ai, vertex 6") has degree ^2 -I- 1 = 3. The edges from 
(1,6) to (1,1) and (1,5) result since in G2, vertex 6 connects to vertices 1 and 5. 
The edge from (1, 6) to (7, 1) result since in Gi, ai is the first neighbor of aj and 07 
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is the sixth neighbor of ai in the labehng of Gi. Similarly, (1,5) connects to (1,6) 
and (1,4) due to the original connections in G2, and (1,5) has an edge to (6,2) 
since ai is the second neighbor of ag and ag is the fifth neighbor of 02. 

Lemma 2. Let Gi (resp., G2) have girth gi and diameter tifresp., g2, t2). Then 
the girth g and diameter t of the replacement product graph G — Gi@G2 are given 
by: (a) girth niin{52, 2(?i} < g < min{(72, 51^2}; and (h) diameter max{t2,2ti} < 

t < ti+t2. 

Proof, (a) Observe that there are cycles of length 52 in G, as G2 is a subgraph of 
G. Moreover, consider two vertices in Gi on a cycle of length gi. Their clouds are 
gi apart in G, so a smallest cycle between them would contain at most 51^2 edges 
(in the worst case, ^2 steps would be needed within each cloud in the Gi-cycle). 
So g < min{(72, 51^2}- For the lower bound, the smallest cycle possible involving 
vertices in different clouds has length 2gi^ and would occur if in the cycle, only one 
step was needed on each cloud. Thus, g > min{g2,2gi}. (b) For the diameter, the 
furthest two vertices could be would occur if they belonged to clouds associated to 
vertices at distance ti apart in Gi, and the path between them in G would require 
at most t2 steps on each cloud. Therefore, t < ^1^2- Similarly, the furthest distance 
between vertices in the same cloud is t2 , and the furthest distance between vertices 
in different clouds is at least 2ti, which would occur if they lie in clouds associated 
to vertices at distance ti apart in Gi, but only one step was needed on each cloud 
on the path. So t > max{t2, 2ii}. □ 

As earlier, let the two components of the product graph be Cayley graphs of the 
type Gi = C{Ga,Sa) and G2 = C{Gb,Sb) and again assume that there is a well- 
defined group action by the group Gt on the elements of the group Gq. Then the 
replacement product graph is again a Cayley graph. If Sa is the union of k orbits, 
i.e., the orbits of ai,a2, . . . ,ak & Ga under the action of Gb, then the replacement 
product graph is the Cayley graph of the semi-direct product group Ga x Gb and 
has S = (ICa, Sb) {J{{o,i, Icb), ■ • ■ , (ofc, Icb)} as the generating set. The degree of 
this Cayley graph is \Sb\ + k and the size of its vertex set is |Ga||Gf,| [8]. (Here 
again, it is easily verified that when fc = 1, the Cayley graph G(Ga x Gb, S) is the 
replacement product originally defined in [H].) 

4. Zig-zag product for unbalanced bipartite graphs 

For the purpose of coding theory it would be very interesting to have a product 
construction of good unbalanced bipartite expanders. In this Section we adapt the 
original zig-zag construction in a natural manner. The main result (Theorem[T]) will 
show that this construction results in a bipartite expander graph if the component 
bipartite graphs are expander graphs. 

Let Gi be a (ci, di)-regular graph on the vertex sets Vi,Wi, where \Vi\ = N 
and \Wi \ = M. Let G2 be a (c2, 0^2) -regular graph on the vertex sets 1^,1^2, where 
IV2I = di and \W2\ — Ci. Let A^^^ and A^^^ denote the second largest eigenvalues 
of the normalized adjacency matrices of Gi and G2, respectively. Again, randomly 
number the edges around each vertex v in Gi and G2 by {1, . . . ,deg{v)}, where 
deg{v) is the degree of v. Then the zig-zag product graph, which we will denote 
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by G = Gi©G2, is a (c2, (i2)-regular bipartite graph on the vertex sets V, W with 
|y| = • di, \W\ = M ■ ci, formed in the foUowing manner: 




b 

1 



V|=Nd[ |w|=Mcj 

Figure 3. Zig-Zag product of two unbalanced bipartite graphs. 

• Every vertex v G Vi and w E W\ of G\ is replaced by a copy of G2. The 
cloud at a vertex v EV\ has vertices V2 on the left and vertices W2 on the 
right, with each vertex from W2 corresponding to an edge from w in Gi. The 
cloud at a vertex w G W\ is similarly structured with each vertex in V2 in 
the cloud corresponding to an edge of w in G\. (See Figure [3l) Then the 
vertices from V are represented as ordered pairs for v G {!,..., A'^} 
and A:e{l,...,c?i}, and the vertices from W are represented as ordered pairs 
(ui,£), for w e {1, . . . ,M} and ^ G {1, . . . ,ci}. 

• A vertex (w, A:) g y is connected to a vertex in W by making three steps in 
the product graph: 

— A small step "zig" from left to right in the local copy of G2. This is a 
step (i;, fc) — > (w, fc[j]), for i e {1, . . . , C2}. 

— A deterministic step from left to right on G\ (w,/c[i]) where 
■i;[fc[i]] is the fc[i]*^ neighbor of v in G\ and v is the neighbor of f 

in G\. 

— A small step "zag" from left to right in the local copy of G2. This is a 
step — > (ti[A:[i]], ^[j]), where the final vertex is in W , for j e 

{1,...,C2}. 

Therefore, there is an edge between (w, fc) and (?;[fc[i]], 

There is a subtle difference in the zig-zag product construction described for the 
unbalanced bipartite component graphs when compared to the original construction 
in [13] . The difference lies in that the vertex set of G does not include vertices from 
the set W2 in every cloud of vertices from V\ and similarly, the vertex set of G does 
not include vertices from V2 in every cloud of vertices from W\ . 



Advances in Mathematics of Communications 



Volume X, No. X (200X), 1-25 



10 



Christine A. Kelley, Deepak Sridhara, and Joachim Rosenthal 



The following theorem describes the major properties of the constructed unbal- 
anced bipartite graph. 

Theorem 1. Let Gi he a {ci, di) -regular bipartite graph on {N,AI) vertices with 
A(Gi) = and let G2 be a [02, d2) -regular bipartite graph on (c?i,ci) vertices 

with X{G2) — A(^\ Then, the zig-zag product graph Gi^G2 is a {c\,d2) -regular 
bipartite on (N ■ di,M ■ ci) vertices with X = X{GiQG2) < X^^^ + A^^) + [A(2)]2. 
Moreover, if X^^^ < 1 and A^^) < 1, then X = A(Gi©G'2) < 1. 



The proof of the expansion of the unbalanced zig-zag product graph is nontrivial 
and will require the remainder of Section [H Several of the key ideas in the following 
proof are already present in the original zig-zag product graph paper |13| . Some 
modifications for balanced bipartite graphs has been dealt in [8]. Note that unlike 
in the original zig-zag product construction |13| , the vertex set of G does not include 
vertices from the set W2 in any cloud of vertices from Vi , nor vertices from V2 in any 
cloud of vertices from Wi. However, the girth of the unbalanced zig-zag product is 
also 4, and this can be seen using a similar argument as in Lemma [1] 

Proof. Let Mq denote the adjacency matrix of G. For convenience, we also let G2 
denote the di x ci matrix that describes the connections between the nodes in V2 to 
the nodes in W2 for the graph G2 , and Gi denote the N x M matrix that describes 
the connections between the nodes in Vi and the nodes in Wi for the graph Gi . This 

"0 G2 " 

Gi 
Gf 

The adjacency matrix for the zig-zag product graph G is given by 



means that the adjacency matrix for the graph G2 is given by M2 = 
and the adjacency matrix for the graph Gi is given by Mi — 









{G^ (E) Im)A2(G2 <E) In) 



(G2®/„)A2(G 





where A2 is a permutation matrix of size Nci x Nci that describes the zig-zag 
product connections. 

The largest eigenvalue of Mg is 02^2 and the corresponding eigenvector is vq = 



1 r 



where the first Ndi components are equal to 1 and the remaining 



Mci components are equal to r 



C2 



ci 



Let Ix denote a column vector of length x with all entries equal to 1. Then, 



the largest eigenvalue of Mi is y/cidi and the corresponding eigenvector is wq 
In 

. wii(-!i'e rt — A / 

ci 



and the corresponding eigenvector is uq 



\fr. Similarly, the largest eigenvalue of A/2 is vc2d2 
, where r2 = \l — — r\ — ^/r. 



Let A2 — max. 



<M2U,U> 



where u 



Ua 
Ub 



That 



<U,li> 

is Ua is a column vector of length di corresponding to the vertices in V2 and Ub 
is a column vector of length ci corresponding to the vertices in W2 ■ We choose u 
such that u ^- uq. Furthermore, u can be written as two vectors it" and where 
m'I is a vector that is parallel to the constant (non-zero) vector and is a vector 
that is perpendicular (or, orthogonal) to the constant (non-zero) vector. That is 
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(Note that, by definition, A2 corresponds to the second largest eigenvalue of M2 
and the corresponding eigenvector u that maximizes A2 in the above is orthogonal 
to the uo, the eigenvector corresponding to the eigenvalue \Jcidi. ) 



Similarly, let Ai 



<M^w,w> _ 



Wa 
Wb 



(Here, Wa is a column vector of length N and Wb is a column vector 



of length M. w can also be broken down as ui = + as above. By definition, 
Ai is the second largest eigenvalue of Mi.) 

The eigenvector of Mq corresponding to the largest eigenvalue C2C?2 is vq = 



tImci 



Let a 



be an eigenvector of Mq, where aa has length Ndi 



and a2 has length Mci. Let em be a basis vector with component value 1 at 

the mth entry and component value elsewhere. Then, the vectors aa and ab 



can be written as = '^^elN] <8i e„, and ab = 



[M] ^b„ 



where 



denotes the Kronecker product, aa„ is the vector aa restricted to the components 
corresponding to the vertices in the n*'' vertex cloud, n G [N] , of the graph G, and 

ab^ , for m <E [M] , is defined similarly. 

Then the second largest eigenvalue of Mq is A = maxQ,_L„o where K = 

{G2®In)A2{G2®Im)- 

Let s = \2{a'f^ Kab)\- Splitting aa^ (and, Qffe^) into parallel and perpendicular 
parts, aa„ = q:o„ + , we can write 



s = 2[ X^((aLm®e„) 

{aijG2®em)A2[ ^ G24, 



nG[Af] 



me[M] 



We want to show that s < /(Ai, A2)(|| aa 



mG[M] 

II ab IP), where /(Ai, A2) is some 



positive- valued function such that /(Ai, A2) < Ai + A2 + A2. Note that aa € 

and ab G M*^=i . 



Observe the following 
1. A2 = max 



2. Ai 



max 



2"a g2Mb 



2uiJgiM)b 

«'a|P + ll«'i>ll 



where 



r, where w = 



3. aa = 



a„ 



, where a^^ e i e [A/'], at = 



where a^^ e M'^Si e [M], and a = 
4. Prom the definition of A2, we have 



ab 



Ua 
Ub 



Wa 
Wb 

Ol-bM 

1+Mci 






G2 ■ 






ll<A2| 


















=^ll Ga^an II < A2 II I 
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This implies that 



_L 



5. Since is orthogonal to the constant vector, we have -L Idi- 



Rewriting, we have that 

ne[JV] me[M] 



+ 2( ^ (all„fG2®e„)i2( ^ ^aa^^ ® e„) 

ne [AT] me [Af] 



ne[JV] me[M] 

+ 2( 51 ("aJ^^2®e„)i2( ^ G2a^^0em). 

ne[JV] me[M] 

So s = Si + S2 + S3 + S4, where 

si=2( 5^ (allj^G2®e„)i2( G^al^^em) 

ne[N] me[M] 

52 = 2( ^ (allj^G2®e„)i2( J2 ^2^^^ ® e„) 

nG[-/V] me[M] 

S3 = 2( ("a„)^G'2®e„)i2( X! <^2aL®em), and 

ne[]V] me[M] 

S4 = 2( ^ (a^^)^G2 0e„)i2( G2a^^(8)em). 

ne[JV] me[M] 

We will bound each part of s separately: 

1. Since A2 is a permutation matrix, wc have 

S4<2|| X! ("«J^^2<8)e„ nil G2ai^<»em\\ 

nelN] me[M] 

Since jj (a^^)'^G2 ||< A2 jj Q!„^ jj by definition of A2 (and similarly, 
II ^^20!^^ II < A2 II Q!j-^ 11)5 we have 

S4 < 2 II Y ^2'^a„ ® e„ nil A2 Y 

ne[N] mG[M] 

= 2X1 W "a !lll «^ ll< AidI air + II ai f) = Ai(|| f) 

2. Since A2 is a permutation matrix, we have 

53 < 2 II Y ("tfG2 ® e„ nil X G2aL ® || 

nG[iV] m£[M] 

Using the argument from the previous step and since || G2Q;|| ||<|| q;|| ||, we 
have 

S3<2A2 II ai nil al \\ 
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3. Similarly, we can show that 

S2<2X2 II all nil ai \\ 

4. To upper bound si, define a new vector C{a'^) for every vector a'^ such that 
its mth component is 

^ a—l 

This implies that a'j' = C(a'J (g) 

Similarly, define a new vector C'{a'ij) for every a'^ as 

{C'{a'f,))n :=-f^a;„, for n e [TV] 

^1 6=1 

This impHcs that a'}'' = C'(al) (g) 

That is, the functions C(-) and C"(-) computes the average value of the 
components in each vertex cloud of the zig-zag product graph G. 

Therefore, wc have C"^2(e„i ^ ^) ^ Gie„i- Note that = q;|^, 

where am in the subscript refers to the left vertices on the right of the zig-zag 
product graph that are used for the construction but do not belong to the 
vertex set of the zig-zag product graph. Rewriting si , we have 



si = 2( ^ ialfG2 ® enfA2i ^ aH^Gj e„) 

ne[Af] me[M] 



ne[N] 



ie[M] 



This is because, («!!„) "^G2 = , the components of the right vertices 

of the G2 clouds on the left of G, and G2(a||^) = Q^l^j the components 
corresponding to the left vertices of the G2 clouds on the right of G. (That is, 
since G2 denotes the connections between the left vertices and right vertices, 
multiplying with G2 takes (aa„)'^ to (a- ) and (q;||^) to (af^)-) 

But ai = {C{aa)) <^ 157, aj = (C'iai) Hence, 



Ici 



si = 2{C'{ai) -^fA2iC{aa) 8) -^) 

2(^(7' (ar))^Gi(^C(aa)) 



But observe that 
This is because 



is orthogonal to the vector 



Ijv 



< 



' ^C'{a,) - 




In 






_ \fr\M _ 



>-- 



^ 6=1 n=l V i V m=l 
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However, J2lLi E„=i = C2 J2a=i E„=i and 



EaLi E^!f=i aa„. = (h EbLi Em=i ■ Since 



ci Y^M 



was chosen to be or- 



thogonal to 



, it is easy to verify that the sum in (**) is zero. 



Sl 



rlMci 

Hence, from the definition of Ai , we have 

^ " / ^ < II C'iai) r + II CK) IP) (*) 

cidi cidi ci di 

It is easy to verify that the RHS in (*) can be upper bounded as 
si<RHS{*)<M\\ al r + \\4 |p) = Ai(|| a" 
Combining the upper bounds on ,si, S2, S3, S4, wc have 

S = Sl + S2 + S3 + S4 

s < Aidl a" f ) + 2A2(|| ai |||| || + || |||| ai ||) + A^(|| a^ f ) 
However, observe that 

2A2(|| ai nil aH || + || a^ \\\\ a," ||) < 

A2(|| aH f + 11 ai f + 11 aH f + || ai f) = A^d a f ). 

Further, || all ||2<|| a f and || a^ f<\\ a f. 
Thus, we have 

s<{Xi + \2 + Xl){\\a\\') 
The second largest eigenvalue of Mq is defined as A = maXc,j^^o <cJa> ' '^^^'^^ 
s = 2aJ(G2 <2) /jv)^2((j2 (S) /m)Q!6- Using the upper bound on s, we get A < 

The only remaining step is to show that if Ai < 1 and A2 < 1, then A < 1. 
Suppose Al < 1,A2 < 1 and suppose || a-"- ||< \\ a \\. Then, we can upper 

bound s as follows 

s < Al II a" f +2A2 II a" nil a-^ \\ +Xl \\ a"^ 



„ „2 2(1- Al) „ „2 (1 - Ai)2 



9 



^=(1-^)^ ll«f<ll«f 



Suppose II a-"- ||> 



l-Ai 

3A2 



Then, notice that s = 2{ai + )(En ^2 ® e„)A2(Em ^2 «) e„)(a|l + ai). The 
RHS can be written as '^{a^l+J2n'^ani^2)'^^n)A2{a\ + J2m^'2'^bm'^^™'- However, 
En'^onC^i') ® 6" is orthogonal to a| and Em^sQ!^^ (S) is orthogonal to a^~. 
Thus, " 

s = 2(aJ)A2(a|) + 2(^a^JG^) ® e„)A2(^G2a^„ ® e„) 

n m 

Prom the previous arguments, we have 

s< Aidl J r) + Xl{\\ a^ ||2) 
= Ai(||a|p-|| r) + Xl II a^ f 

(1-Ai)2(l-Ai) 



< (II af -II a^ f) + Xl II a^ f={l 
This completes the proof. 
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5. Zig-zag and replacement product LDPC codes 

In this section, we design LDPC codes based on expander graphs arising from 
the zig-zag and replacement products. The zig-zag product of regular graphs yields 
a regular graph which may or may not be bipartite, depending on the choice of the 
component graphs. Therefore, to translate the zig-zag product graph into a LDPC 
code, the vertices of the zig-zag product are interpreted as sub-code constraints of 
a suitable linear block code and the edges are interpreted as code bits of the LDPC 
code. This is akin to the procedure described in [16j and [7]. The same procedure 
is applied to the replacement product graphs. 

We further restrict the choice of the component graphs for our products to be 
appropriate Cayley graphs so that we can work directly with the group structure of 
the Cayley graphs. The following examples, the first two using Cayley graphs from 
[2], illustrate the code construction technique: 

Example 3. Let ^ = F2 be the Galois field of 2^ elements for a prime p, where the 
elements of A are represented as vectors of a p-dimensional vector space over F2. 
Let B = Zp he the group of integers modulo p. (Further, let p be chosen such that 
the element 2 generates the multiplicative group Z* = Zp — {0}.) The group B acts 
on an element x = {xo,xi, . . . , Xp^i) G A by cyclically shifting its coordinates, i.e. 
(f>bi^) = {xb, Xb+i, . . . , Xb-i), V& G B. Let us now choose k elements oi, 02, ... , Ofc 
randomly from A. The result in [2 Theorem 3.6] says that for a random choice 
of elements ai, a2, . . . ,ak, the Cayley graph C{A, {af , af , . . . , a^}) is an expander 
with high probability. (Here, af is the orbit of Oi under the action of B.) The 
Cayley graph for the group B with the generators {±1} is the cyclic graph on p 
vertices, C{B,{±1}). 

(a) The zig-zag product of the two Cayley graphs is the Cayley graph 

C(Ax B,^ = {(0,/3)(a„0)(0,/?')| /?, = ±1, z = 1, 2, .., A:}) 

on = 2*^ -p vertices, where Axi B is the semi-direct product group and the group 
operation is (a, b)(c, d) = {a + (j)b{c),b + d), for a,cG A, b,d G B. This is a regular 
graph with degreqj dg < fej^sp = 4fc. If we interpret the vertices of the graph as 
sub-code constraints of a [dg,kg,dm] Hnear block code and the edges of the graph 
as code bits of the LDPC code, then the block length Nld of the LDPC code is 
2P ■ p ■ dg/2 and the rate of the LDPC code is 

- Njdg -kg) _^ 2{dg ~ kg) _ 2kg ^ 

~ dg dg 

(Observe that r > 2ri — 1, where ri is the rate of the sub-code.) 

(b) The replacement product of the two Cayley graphs is the Cayley graph 

C{A X B, 5 = (0, Sb) U {(a„ 0)|^ = 1, 2, .., k}) 

on N = 2P ■ p vertices, where A x _B is the semi-direct product group and the 
group operation is (a, 6)(c, d) = {a + (f>b{c),b + d), for a,c & A, b,d & B. This is a 
regular graph with degree dg — k + \Sb\ = k + 2. We interpret the vertices of the 
graph as sub-code constraints of a [dg, kg, d^] linear block code and the edges of 



■^Depending on the choice of the a^'s, the number of distinct elements in S may be fewer than 
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the graph as code bits of the LDPC code, to obtain an LDPC code of block length 
Nld = 2p -p- dg/2 and rate 

- Njdg - kg) _ ^ 2{dg - kg) _ 2kg ^ 

~ Nld dg dg 

(Observe that r > 2ri — 1, where ri is the rate of the sub-code.) □ 



In some cases, to achieve a certain desired rate, we may have to use a mixture of 
sub-code constraints from two or more linear block codes. For example, to design 
a rate 1/2 LDPC code when dg is odd, we may have to impose a combination of 
[dg,kg,dmi] and [dg,kg + l,dm2] block code constraints, for an appropriate kg, on 
the vertices of the graph. 

Example 4. Let B = SL2(¥p) be the group of all 2 x 2 matrices over Fp with 
determinant one. Let 'S'b = |^q l)}^*^ generating set for the 

Cayley graph C{B,Sb)- Further, let Pi = Fp U {oo} be the projective line. The 
Mdbius action of B on Pi is given by ^ ^ d ) "^^^ ^ ^'^^ ^ ^ and let 

the action of B on the elements of A be the Mobius permutation of the coordinates 
as above. If we now choose k elements 01,02, ... ,afc randomly from A as in the 
previous example, then [5] again shows that with high probability, the Cayley graph 
C{A, {of, . . . , of}) is an expander. 

(a) The zig-zag product of the two Cayley graphs is the Cayley graph 

C{A X = {(U,/3)(o„1b)(U,/3')| € ^s, z = 1, 2, .., fc}) 

on \A\\B\ = 2P+i(p3-p) vertices. (Note that Is = q ^ ^ and U = q \ ^.) 

However, this Cayley graph will be a directed Cayley graph since the generating 
set S is not symmetric. Hence, we modify our graph construction by taking two 
copies of the vertex set A B. A vertex v from one copy is connected to vertex w 
in the other copy if there is a s € S* such that v * s = w. The new product graph 
obtained has 2|v4||i3| vertices and every vertex has degree dg = \S\] moreover, it is 
a balanced bipartite graph. An LDPC code of block length |74||i3|(ig is obtained by 
interpreting the vertices of the graph as sub-code constraints of a [dg, kg, dm] linear 
block code, and the edges as code bits of the LDPC code. The rate of this code is 

^ ^ I _ 2(1^3 ~ kg) _ 2fcg ^ ^ 

dg dg ' 

(b) The replacement product of the two Cayley graphs is the Cayley graph 

C{A yoB,S= {1a, Sb) U {(o„ Ib)\i = 1,2,..., k}), 

on = 2P+^(p'^ ~ p) vertices. Here also, the Cayley graph will be a directed 

Cayley graph since the generating set S is not symmetric. Hence, we modify our 
graph construction by taking two copies of the vertex set A y\ B. A vertex v from 
one copy is connected to vertex w in the other copy if there is a s € 5' such that 
V s = w. The new product graph obtained has 2|A||i?| vertices and every vertex 
has degree dg = \S\; moreover, it is a balanced bipartite graph. An LDPC code 
of block length |^||i3|c?g is obtained by interpreting the vertices of the graph as 
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sub-code constraints of a [dg, kg, dm] linear block code, and the edges as code bits 
of the LDPC code. The rate of this code is 

^ I _ 2(ctg — kg) _ 2fcg ^ ^ 
dg dg ' 

□ 



Example 5. Codes from unbalanced bipartite zig-zag product graphs. 
Using a random construction, we design a (ci, c?i)-regular bipartite graph Gi on 
(iV, Al) vertices. Similarly, we design a (c2, d2)-regular bipartite graph G2 on (c?i, ci) 
vertices. The zig-zag product of Gi and G2 is a {c2,d2)-Tegular graph on {N-di,M- 
ci) vertices. An LDPC code is obtained as before by interpreting the degree c| 
vertices [resp. degree vertices] as sub-code constraints of a C51 = [c|, c?mi] 
[resp. a Cs2 = M2:^2,c?m2]] linear block code and the edges of the product graph 
as code bits of the LDPC code. The block length of the LDPC code thus obtained 
is Nld — NdiC2 and the rate is 

^ Ndicl - {Ndijcl - fci) + Mcijdl - fc2)) _ fci fc2_-^ 
^~ Ndicl ~ cf d| 

(since Ndic\ = Mcid\ is the number of edges in the graph). Observe that r > 
ri + r2 — 1, where ri and r2 are the rates of the two sub-codes Csi and Gs2, 
respectively. □ 



6. Performance of Zig-zag and Replacement Product LDPC Codes 

The performance of the LDPC code designs based on zig-zag and replacement 
product graphs is examined for use over the additive white Gaussian noise (AWGN) 
channel. (Binary modulation is simulated and the bit error performance with re- 
spect to signal to noise ratio (SNR) Eb/No is determined.) The LDPC codes are 
decoded using the graph based iterative sum-product (SP) algorithm. Since LDPC 
codes based on product graphs use sub-code constraints, the decoding at the con- 
straint nodes is accomplished using the BCJR algorithm on a trellis representation 
of the appropriate sub-code. (A simple procedure to obtain the trellis representation 
of the sub-code based on its parity check matrix representation is discussed in ) 
It must be noted that as the number of states in the trellis representation and the 
block length of the sub-code increases, the decoding complexity correspondingly 
increases. 

Figure |4] shows the performance of the zig-zag product LDPC codes based on 
Example 4.1, with sum-product decoding. For the parameters p — b and k — 5, 
five elements in A = are chosen (randomly) to yield a set of generators for 
the Cayley graph of the semi-direct product group. The Cayley graph has 160 
vertices, each of degree 20. The sub-code used for the zig-zag LDPC code design 
is a [20,15,4] code and the resulting LDPC code has rate 1/2 and block length 
1600. The figure also shows the performance of a LDPC code based on a randomly 
designed degree 20 regular graph on 160 vertices which also uses the same sub-code 
constraints as the former code. The two codes perform comparably, indicating that 
the expansion of the zig-zag product code compares well with that of a random 
graph of similar size and degree. Also shown in the figure is the performance of 
a (3, 6) regular LDPC code, that uses no special sub-code constraints other than 
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Figure 4. LDPC codes from zig-zag product graphs based on Ex- 
araple 4.1. 

siraple parity check constraints, having the same block length and rate. Clearly, 
using strong sub-code constraints improves the performance significantly, albeit at 
the cost of higher decoding complexity. The figure also shows another set of curves 
for a longer block length design. Choosing p = 11 and fc = 5 and the [20,15,4] 
sub-code constraints yields a rate 1/2 and block length 225,280 zig-zag product 
LDPC code. At this block length also, the LDPC based on the zig-zag product 
graph is found to perform comparably, if not, better than the LDPC code based 
on a random degree 20 graph. The zig-zag product graph has a poor girtljl and 
this causes the performance of the zigzag LDPC code to be inferior to that of the 
random LDPC codes at high signal to noise ratios. 

Figure [5] shows the performance of a replacement product LDPC code based on 
Example 4.1, with sum-product decoding. For the parameters p = 11 and k = 13, 
13 elements in A = are chosen (randomly) to yield a set of generators for 
the Cayley graph of the semi-direct product group. The Cayley graph has 22,528 
vertices, each of degree 15. The sub-code used for the replacement product LDPC 
code design is a [15,11,3] Hamming code and the resulting LDPC code has rate 
0.4667 and block length 168,960. The figure also shows the performance of a LDPC 
code based on a randomly designed degree 15 regular graph on 22,528 vertices 
which also uses the same sub-code constraints as the former code. Here again, the 
two codes perform comparably, indicating that the expansion of the replacement 
product code compares well with that of a random graph of similar size and degree. 

Figure [S] shows the performance of zig-zag product LDPC codes based on Exam- 
ple 4.2, with sum-product decoding. Once again, this performance is compared with 
the analogous performance of a LDPC code based on a random graph using identi- 
cal sub-code constraints and having the same block length and rate. These results 

^Note that there is no growth in the girth of the zig-zag product graph as opposed to that for 
a randomly chosen graph, with increasing graph size. 
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Figure 5. LDPC code from replacement product based on Exam- 
ple 4.1. 

are also compared with a (3, 6) regular LDPC code that uses simple parity check 
constraints. For the parameters p — 3 and fc = 5 in Example 4.2, a bipartite graph, 
based on the zig-zag product graph, on 768 vertices with degree 20 is obtained. 
Using the [20,15,4] sub-code constraints as earlier, a block length 7680 rate 1/2 
LDPC code is obtained. This code performs comparably with the random LDPC 
code that is based on a degree 20 randomly designed graph. Using the parameters 
p = 5 and fc = 4 and a [16, 12, 2] sub-code, a longer block length 122,880 LDPC 
code is obtained. As in the previous case, this code also performs comparably, if 
not, better than its random counterpart for low to medium signal-to- noise ratios 
(SNRs). Once again, we attribute its slightly inferior performance at high SNRs to 
the poor girth of the zig-zag product graph. 

Figure [7] shows the performance of a replacement product LDPC code based on 
Example 4.2, with sum-product decoding. Once again, this performance is com- 
pared with the analogous performance of an LDPC code based on a random graph 
using identical sub-code constraints and having the same block length and rate. For 
the parameters p = 5 and A; = 13 in Example 4.2, a bipartite graph, based on the 
replacement product graph, on 15,360 vertices with degree 15 is obtained. Using 
the [15,11,3] Hamming code as a sub-code in the replacement product graph, a 
block length 115,200 rate 0.4667 LDPC code is obtained. The performance of the 
replacement product LDPC code is inferior to that of the random code in this ex- 
ample due to the poor choice of the generators in the component Cayley graphs. 
We believe a more judicious choice would improve the performance considerably. 

Figure [8] shows the performance of LDPC codes designed based on the zig-zag 
product of two unbalanced bipartite graphs as in Example 4.3. A (6, 10)-regular 
bipartite graph on (20, 12) vertices is chosen as one of the component graphs and a 
(3, 5) -regular bipartite graph on (10,6) vertices is chosen as the other component. 
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Figure 6. LDPC codes from zig-zag product graphs based on Ex- 
araple 4.2. 
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Figure 7. LDPC code from replacement product based on Exam- 
ple 4.2. 



Their zig-zag product is a (9, 25)-regular bipartite graph on (200, 72) vertices. Using 
sub-code constraints of two codes - a [9,6,2] and a [25,21,2] linear block code 
- a block length 1800 LDPC code of rate 0.5066 is obtained. The performance 
of this code is compared with a LDPC code based on a random (9, 25)-regular 
bipartite graph using the same sub-code constraints, and also with a block length 
1800 random (3, 6) regular LDPC code. All three codes perform comparably, with 
the random (3, 6) showing a small improvement over others at high SNRs. Given 
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Figure 8. LDPC code from the unbalanced bipartite zig-zag prod- 
uct graph based on Example 4.3. 



that the zigzag product graph is composed of two very small graphs, this result 
highlights the fact that good graphs may be designed using just simple component 
graphs. 



7. Iterative construction of generalized product graphs 

In this section, we introduce iterative families of expanders that address an im- 
portant design problem in graph theory and that have several other practical en- 
gineering applications such as in designing communication networks, complexity 
theory, and derandomization techniques. 

For code constructions, we would ideally use products that could be iterated to 
generate families of LDPC codes having a slow growth in the number of vertices 
(so as to get codes for many block-lengths), while maintaining a constant (small) 
degree. The iterative families described in this section have these characteristics, 
but unfortunately do not have parameters that make the codes practical. Designing 
such iterative constructions suitable for coding is a nice open problem. 

First we review the iteration scheme of [13] for the original zig-zag product start- 
ing from a seed graph H. The existence of the seed graph H as well as explicit 
examples of suitable seed graphs for H are also discussed in [T31. We present new 
iterative constructions of a modified unbalanced bipartite zig-zag product and the 
replacement product thereafter. 



7.1. Iterative construction of original zig-zag product graphs. We wiU 
need a squaring operation and the zig-zag operation in the iterative technique that 
is proposed next. Note that for a graph G, its square is a graph whose vertices 
are the same as in G and whose edges are paths of length two in G. Further, if G 
is a (N, D, A) graph, then is a (TV, , A^) graph. 
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A graph H is used to serve as the basic building block for the iteration. Let H 



The above iterative construction indeed gives a family of expanders as presented 
in the following result: 

Theorem 2. [T3] For every i, Gi is an Z?^, |) graph. 

7.2. Iterative construction of unbalanced bipartite zig-zag product 
GRAPHS. The unbalanced bipartite zig-zag product presented in Section |4] cannot 
be used directly to obtain an iterative construction, due to constraints on the pa- 
rameter^. Therefore, we slightly modify the zig-zag product by introducing an 
additional step on the small component graph in the product construction. We 
note that the introduction of this additional step can only increase the expansion 
of the zig-zag product graph. However, this increase in expansion is at the cost of 
increasing the degree of the graph slightly. The new modified unbalanced bipartite 
zig-zag product is presented next, followed by an iterative construction that uses 
this product. 

7.2.1. Modified unbalanced bipartite zig-zag product. The two component graphs 
are unbalanced bipartite graphs, i.e., the two sets of vertices have different degrees. 
Let Gi be a (ci, di)-regular graph on the vertex sets Vi,Wi, where \Vi\ = N and 
\Wi\ = M. Let G2 be a (c2, c?2)-regular graph on the vertex sets V2,W2, where 
IV2I = di and \W2\ = ci. Let Ai and A2 denote the second largest eigenvalues of 
the normalized adjacency matrices of Gi and G2, respectively. Again, randomly 
number the edges around each vertex v in Gi and G2 by {1, . . . ,deg{v)}, where 
deg{v) is the degree of v. Then the zig-zag product graph, which we will denote by 
G — Gi@fG2, is a (02^2, (i2C2)-regular bipartite graph on the vertex sets V, W with 
\V\ = N ■ di, \W\ = M ■ di, formed in the following manner: 

• Every vertex w e Vi and w; G Wi of Gi is replaced by a copy of G2. The 
cloud at a vertex v Q Vi has vertices V2 on the left and vertices W2 on the 
right, with each vertex from W2 corresponding to an edge from u in Gi. The 
cloud at a vertex w G Wi is similarly structured with each vertex in V2 in 
the cloud corresponding to an edge of w in Gi. (See Figure [3l) Then the 
vertices from V are represented as ordered pairs (w,fc), for v € {I, . . . , N} 
and and the vertices from W are represented as ordered pairs 
{w,i), for u; G {1, . . . ,M} and ^ G {1, . . . ,ci}. 

• A vertex (v, fc) G is connected to a vertex in W by making four steps in the 
product graph. The first three steps are the same as in Section U) The fourth 
step is: 

— A second small step from right to left in the local copy of G2. This is a 
step (w[fc[«]], ^[j]) {v[k[i]],£[j][j']), where the final vertex is in W, for 



* The only parameters that were compatible were for the special case where the bipartite 
components were balanced. 



be any {D' 




f e {!,..., d2}. 
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Theorem 3. Let Gi he a (ci, di) -regular bipartite graph on {N,M) vertices with 
A(Gi) = Ai, and let G2 he a {02, d2)- regular bipartite graph on (c?i,ci) vertices with 
A(G2) — A2. Then, the modified zig-zag product graph GiiQ/G'2 is a {c\d2,C2d'^)- 
regular bipartite on (N ■ di,M ■ di) vertices with A = A(GiiU/G2) < Ai + A2 + A2. 
Moreover, if Xi < 1 and A2 < 1, then A = A(Giig)jG2) < 1. 

The proof is omitted but may be seen intuitively given the expansion of the 
original unbalanced zig-zag product (Theorcm[T]) in the following way. The new step 
is independent of the previous steps and is essentially a random step on an expander 
graph (G2). Considering a distribution on the vertices {v,k) oi G — GiQ)iG2, if 
the distribution of k conditioned on v is close to uniform after step 3, then step 4 is 
redundant and no gain is made. If the distribution of k conditioned on v is not close 
to uniform after step 3, then step 4 will increase the entropy of k by the expansion 
of G2. 

7.2.2. Iterative construction. The modified zigzag product of Gi — {N, M, ci, c?i, Ai) 
and G2 = (di, ci, C2, (i2, A2) is a graph G — Gi'QiG2 that is (02^2, 22^2 )-regular on 
{Ndi, Mdi) vertices. For the iteration, let H be any (TV — cidl, M — €2^2, C2, d2, A) 
expander graph, Then, the iteration is defined by 

Gi=H^^ {N, M, cld2,c2dl A^). 
G,+i - GlQsH. 

We show that the above iterative technique yields a family of expanders in the 
following 

Theorem 4. Let H be a (02^3, 02^2, C2, rf2. A) graph, where A < 0.296. Let Gi = 
and Gi+i = Gf^iH. Then the i-th iterated zig-zag product graph Gi is a 
{{cfdl\cl'+^dl'-\cld2,C2dl,X') graph, where A' < 0.55. 



Proof. Let rii and be the number of left vertices and right vertices in Gi , respec- 
tively. Since Gi — G^_i^H , we have rii = ni_i(c|d2) ^iid rrii = TOi_i(c2(i2)- Since 
Til ~ c\d\ and mi = c\d\, it follows from the above recursion that Ui — c\^d^ and 
TOj = C2*'''^d2*~^- Note that Gi is always (02^2, C2d|)-regular. 

Let \i be the normalized second eigenvalue of Gi. Using the result from Theo- 
rem [31 we have 

A. < Ati +A + A2. 

Further note that Ai = A'^. Observe that even for Ai — ^l-i + A + A^, the series 
converges Ai — > 0.5499 when A < 0.296. Hence, for each iteration i, Ai < 0.55, 
thereby yielding a family of expanders. □ 
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7.3. Iterative construction of replacement product graphs. The re- 
placement product of d = {N,di,Xi) and G2 = {di,d2, X2), denoted by Gi@G'2, is 
an {Ndi, c?2 + 1, A) graph. In [13 , it is shown that the expansion of the replacement 
product graph is given by 

(1) A< (p+(l-p)/(Ai,A2))i 

where p = ^^^"^^^^3 and /(Ai, A2) = ^(1 - A^)Ai + - A2)2A2 + 4A2. 

To obtain an iterative construction, we choose two graphs Gi = {N, {d+ 1), Ai) and 
H=iid+l)\d, A2). 

The iteration is defined by 

G,+i = {Gif®H- 

We show that the above iterative construction results in a family of expanders. 

Theorem 5. Let Gi be a {N, {d + 1), Ai) graph and let H be a {{d + A2) 
graph, where Ai < 0.2, A2 < 0.2 and d > 6. Let G^+i = {Gi)*@H . Then the i-th 
iterated replacement product graph Gi is a {N{d + 1)4(^-1), d + 1, A) graph, where 
A < 0.86. 

Proof. Let n.^ be the number of vertices in Gi. Then rii = ni-i{d + 1)^. Since 
Til — N, it follows that Ui = N{d + It is clear that the degree of Gi is one 

more than the degree of 77, and thus, Gi is (d-f l)-regular. Let A^ be the normalized 
second eigenvalue of Gi . Using the result from Equation ^ , we have 

A. < b+(l-p)/(Ati,A2)]^ 

where p = (^^li-^^ and / is as above. Using numerical methods with Matlab, it was 
verified that Ai converges to 0.8574 when Ai < 0.2, A2 < 0.2, and d> 6. Hence, for 
each iteration i, Ai < 0.86, thereby yielding a family of expanders. □ 

Note that if the above iteration was defined to be Gi+i = {Gi)^@H, then for no 
choice of Ai, A2, or d, would the resulting iterative family be expanders. 

8. Conclusions 

In this paper we generalized the zig-zag product resulting in a product for unbal- 
anced bipartite graphs. We proved that the resulting graphs are expander graphs 
as long as the component graphs are expanders. We examined the performance of 
LDPC codes obtained from zig-zag and replacement product graphs. The resulting 
product LDPC codes perform comparably to random LDPC codes with the ad- 
ditional advantage of having a compact description. We also introduced iterative 
constructions for the unbalanced zig-zag and replacement products yielding families 
of graphs with small, constant or slowly increasing degrees, and good expansion. 
Although these iterative schemes do not yield parameters for practical codes as yet, 
we believe they provide a first step in exploring iterated products for code construc- 
tion. Designing iterative graph products that result in a family of good practical 
codes remains an intriguing open problem. We conclude that codes from product 
graphs provide a nice avenue for code constructions. 
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